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Abstract 

Time evolution of diluted neural networks with a nonmonotonic transfer function 
is analitically described by flow equations for macroscopic variables. The macroscopic 
dynamics shows a rich variety of behaviours: fixed-point, periodicity and chaos. We 
examine in detail the structure of the strange attractor and in particular we study the 
main features of the stable and unstable manifolds, the hyperbolicity of the attrac- 
tor and the existence of homoclinic intersections. We also discuss the problem of the 
robustness of the chaos and we prove that in the present model chaotic behaviour is 
fragile (chaotic regions are densely intercalated with periodicity windows), according 
to a recently discussed conjecture. Finally we perform an analysis of the microscopic 
behaviour and in particular we examine the occurrence of damage spreading by study- 
ing the time evolution of two almost identical initial configurations. We show that for 
any choice of the parameters the two initial states remain microscopically distinct. 



PACS numbers: 87.10. +e, 05.20.-y, 05.45.+b 



1 Introduction 

Since the pioneering work by Sompolinsky et al. |l|], the occurrence of oscillations and chaos 
has become a major field of interest in the frame of neural networks 0. Neural networks 
with symmetric synaptic connections have been object of extensive studies by methods closely 
related to those used in the theoretical description of the spin glasses 0, since they admit 
an energy function. Also asymmetric synapses have been studied and the presence of chaotic 
dynamics was examined, following [l], in a number of subsequent papers (see e.g. f|, |j. [| 
|7|, §]). The investigation of chaotic neural networks is interesting not only from a theoretical 
point of view, but also for practical reasons, as their dynamical possibilities are richer and 
allow for a larger spectrum of engineering applications (see, e.g., Ref. 0). It is also worth 
stressing that the brain is a highly dynamic system. The rich temporal structure (oscillations) 



of neural processes has been studied in Wu, 11, 12, 13]; chaotic behaviour has been found 



out in the nervous system Relying on these neurophysiological findings, the study of 
chaos in neural networks may be useful in the comprehension of cognitive processes in the 
brain JT5J . 

Asymmetric synapses are not the only route to chaos in neural networks; another possi- 
bility is to use a nonmonotonic functional dependence for the activation function, i.e. the 
transfer function that gives the state of the neuron as a function of the post-synaptic po- 



tential. In recent papers |16|, [17) it has been shown that such a nonmonotonic transfer 
function may lead to macroscopic chaos in attractor neural networks: chaos appears in a 
class of macroscopic trajectories characterized by an overlap with the initial configuration 
that never vanishes. In other words, the network preserves a memory of the initial configu- 



ration, but the macroscopic overlap does not converge to a fixed value and oscillates giving 
rise to a chaotic time series. Also the case of diluted networks with dynamical, adaptative 
synapses and nonmonotonic neurons in presence of a Hebbian learning mechanism has been 



studied, and it has been found that the adaptation leads to reduction of dynamics [18|. 

In this paper we further analyze the dynamic behaviour of attractor neural networks with 
nonmonotonic transfer function. In particular we analyze a network by mean-field equations 



whose macroscopic dynamics can be analitically calculated ^U|. The time evolution of 
the macroscopic parameters describing the system is determined by a two-dimensional map 
that exhibits chaotic behaviour and represents in our opinion a non trivial and interesting 



example of a non-linear dynamical system (for recent reviews see e.g. [[H], |22|). In the 
present work the following issues are considered: structure and hyperbolicity of the strange 
attractor, Hausdorff dimension and Lyapunov exponents. These are typical analyses of the 
non linear dynamical behaviour that we perform in a neural-motivated two-dimensional map 
in order to achieve a better understanding of the dynamics of this class of neural networks. 
We also analyze the problem of the fragility of chaos and we explicitly prove that the present 
model behaves in agreement with the conjecture in P3|, i.e. that periodicity windows are 



constructed around spine loci (one-dimensional manifolds in the two-dimensional parameter 
space of the model here considered). This is in our opinion an interesting confirmation of 
this conjecture that sheds light on the geometrical features of the periodicity windows to be 
found in the chaotic regions. Finally, we examine the microscopic behaviour underlying the 
mean field description: we consider two replicas of the system starting from slightly different 
initial conditions and we show that these two different configurations never become identical, 
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independently of their macroscopic behaviour. This feature was already observed in diluted 
networks with monotone transfer function ]n|; here we prove that such behaviour is also 
present in the case of nonmonotonic neurons. It follows that at microscopic level the network 
dynamics is always to be considered chaotic, whereas from a macroscopic, mean field point 
of view, a rich variety of behaviours can occurr: fixed-point, periodicity and chaos. We note 
that a similar emergence of a macroscopic evolution in presence of microscopic chaos has 
been recently found in another framework, i.e. Chaotic Coupled Maps models, and it has 
been termed nontrivial collective behaviour (NTCB, see p4| and references therein). 



The paper is organized as follows: in the next section the model is described and the flow 
equations for macroscopic parameters are reported and analyzed. In section 3 we study the 
time evolution of the distance between two replicas of the network. In section 4 we present 
our conclusions. 

2 The model: analysis of flow equations. 

We consider the model of Ref. |TS[, i.e. a neural network with N three-states neurons (spins) 



Si(t) G {—1,0,1}, i = 1,...,N. For each neuron Si, K input sites ■ ■ ■ , Jk (i) are 

randomly chosen among the N sites, and NK synaptic interactions Jij are introduced. We 
assume that the synapses are two-states variables G { — 1,1}, randomly and independently 
sampled with mean J ; they are not assumed to evolve in time (the case of adapting synapses 



is studied in [18]). A parallel deterministic dynamics is assumed for neurons, where the local 



field acting on neuron Si (the post synaptic potential) is given by 



with the sum taken over the K input neurons. We assume a nonmonotonic transfer function, 



depending on the parameter 9 [25, 26, 27, 28, 29 : 



Si (t + 1) = F (hi(t)) , 



(2) 



where Fg(x) = sign(x) when \x\ < 9 and vanishes otherwise. 

The dynamics of this model is solved by macroscopic flow equations for the parameters 
describing the system. Let us now introduce order parameters for the neurons. The overlap 
with pattern {£} to be retrieved (we choose {£ = 1} for simplicity) is measured by m(t) = 
(s(£)). We stress that the suppression of the site index i is possible because all averages are 
site- independent. The neuronic activity is given by Q(t) = (s 2 (t)). The flow equations for 



m and Q have been obtained in [lqj: 



m(t + 1) = erf 



erf 



9 + /i(t) 



erf 



9 - n(t) 
7® 



(3) 



where 



Q(t + 1) 



a{t) 



a(t) 



(4) 



H(t) = Km(t)J 



(5) 



and 



a(t) = K (Q(t) - 4 



2 2 

m 



(6) 



are mean and variance, respectively, of the local field acting on neurons at time t. 

Depending on the value of 9 and Jo, three kinds of dynamic behaviour are possible for the 



network, which lead to a phase diagram fl8|| . Two fixed point ordered phases are present, 



the ferromagnetic phase (F) characterized by m > 0, Q > and the self-sustained activity 
phase (S) characterized by m = 0, Q > 0. A phase without fixed points, corresponding 
to cyclic or chaotic attractors and characterized by mt > 0,Qt > 0, is also found; we call 
it period- doubling phase (D). We remark that the phase corresponding to the fixed-point 
(m = 0, Q = 0) is missing in this model. According to the values of the parameters we can 
get a phase or another; in Fig. 1 the bifurcation diagram of m versus Jo, while keeping 8 = 5 
fixed, is shown (for K = 10). The S fixed point is stable for J < 0.5; at J ~ 0.5 the F fixed 
point continously appears and remains stable until Jo ~ 0.69, where a bifurcation to a stable 
2-cycle take place. The bifurcation mechanism is period doubling, i.e. an eigenvalue of the 
Jacobian matrix at the fixed point leaves the unitary disk passing through —1. Increasing J , 
successive bifurcations arise; eventually the system enters in the chaotic region at Jo ~ 0.88. 
In the chaotic region windows of periodicity intercalate with chaotic attractors, which is 
a well-known feature of dynamical systems with chaotic behaviour. We verified that the 
values of Jo where the successive bifurcations take place are consistent with Feigenbaum's 
universality law [301, i.e. the length in Jq of the range of stability for an orbit of period 2 n 



decreases approximately geometrically with n and the ratio of successive range lengths is 
close to 4.669... for large n. We note that, in the phase D, the two-dimensional map (3-4) 
still possesses the F and S fixed points, but they are unstable. 

Let us now consider the strange attractor and its dependence on Jo. For example, in Fig. 2 
the strange attractor is shown, for 9 = 5 and K = 10, in correspondence with J = 0.9, 0.95 
and 0.99 respectively; the fixed point F is represented by a star. In the case J = 0.9, 
the attractor is made of two disconnected components; in the stationary regime successive 
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points on the attractor jump from one component to the other. As Jo grows (Jo = 0.95), 
the attractor evolves into a more complicated structure, still composed of two disconnected 
components. We remark that in these two cases the fixed point F is not a limit point of the 
attractor. At J = 0.99 the two components of the attractor merge and F becomes a limit 
point of the attractor. 

Concerning the Hausdorff dimension of the attractor, we found it to be close to 0.95 
in the three cases described above (the dimension was estimated by the method described 



m 



311 , see also 

Let us now discuss the hyperbolicity of the attractor. We remind that in the hyperbolic 
case many interesting properties about the structure and dynamics of chaos hold (see, e.g. 



2% |22fl). In Fig. 3 we have shown finite length segments of the stable manifold of the fixed 
point F (for J = 0.99, 9 = 5,K = 10); since F is on the attractor, we can argue that the 
attractor is the closure of the unstable manifold of F. We note that the stable and unstable 
manifolds have homoclinic intersections. Moreover Fig. 3 displays near tangencies between 
the stable and unstable manifolds; it is reasonable that some other segment of the stable 
manifold will be exactly tangent to the unstable manifold. We conclude, therefore, that the 



attractor is not hyperbolic (see |2]| for a discussion on the non-hyperbolicity of Henon's 



attractor |33|], which has similarities with the attractor of the map here considered). 

We continue our analysis of the dynamical properties of the neural model and we turn 
now to the Lyapunov exponents. By evaluating the Jacobian of the map, we find it to be area 
contracting, therefore there is one positive Lyapunov exponent at most. We have evaluated 
the first (Ai) and the second Lyapunov (A2) exponents by the method of Ref. |34j] and 



7 



the results are displayed in Figs 4a) and 4b): as expected, the second Lyapunov exponent is 
always negative. For a given model, the ratio of the number of free parameters to the number 



of positive Lyapunov exponents seems to be related, according to a conjecture in p3fl , to the 
fragility of chaos: if this ratio is greater or equal to one a slight change of the parameters 
can tipically destroy chaos and a stable periodic orbit sets in. Since in our case the ratio is 
2 (we have two parameters, Jo and 9) we conclude that the macroscopic chaos of the model 
should be fragile. In Fig. 5 a portion of the parameter space is depicted; here black pixels 
correspond to chaotic attractors and white pixels to stable periodic attractors. One can see 
that extended periodicity windows are present; they are apparently everywhere dense. The 
above cited conjecture in [^U is based on the idea that periodicity windows are constructed 
around spine loci, i.e. values of the parameters that give rise to superstable orbits. For two 
dimensional maps, the spine locus of cycles with period p is determined by the conditions 
detM = and trM = 0, where M is the Jacobian matrix of the p-iterated map. Our map has 
no critical points (like, e.g., the Henon's map) because the determinant of the Jacobian never 
vanishes; hence the condition detM = can not be strictly satisfied. However, since the map 



is area contracting, detM ~ for a periodic orbit with sufficiently high period p (see [KB 



one can therefore neglect the condition detM = and the stability requirements reduce to 
one condition for stability, which according to the discussion above is trM = 0. It follows 
that the spines are of codimension one, i.e. one-dimensional manifolds in the Jo — 9 plane. 
In Fig. 6 we have shown finite length segments of the spine loci determined by the condition 
trM = with p = 32, 64, and 24. Since we do not have an analytic treatment of the two- 
dimensional map, we have implemented the condition trM = numerically. White areas are 
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periodicity windows which are apparently constructed around spine loci; hence the conjecture 



in 



is confirmed. We note, in passing, that our findings confirm that the behaviour of 



two-dimensional area-contracting maps is often similar to that of one-dimensional maps with 



critical points [35]. 



The concept of robust chaos as associated with an attractor for which the number of 
positive Lyapunov exponents (in some region of parameter space) is larger than the number 
of free (accessible) parameters in the model has been also discussed in PEfl ; recently it has 
been pointed out that nonmonotonic transfer functions may lead to robust chaos in time 



series generated by feed-forward neural nets |37|. Probably fully connected networks with 



nonmonotonic activation function might provide robust chaos; however the analytic analysis 
of these models is difficult since the dynamical theory which describe the fully connected 



Hopfield model [38] has not yet been extended to the case of nonmonotonic neurons. 



3 Damage spreading. 

A system is said to exhibit damage spreading if the distance between two of its replicas, 
that evolve from slightly different initial conditions, increase with time (see, e.g., J&J). Even 
though damage spreading was first introduced in the context of biologically motivated dy- 
namical systems |4(J, it has become an important tool to study the influence of initials 



conditions on the time evolution of various physical systems. In |l9j this phenomenon was 
studied in diluted networks with monotonic transfer function. The occurrence of damage 
spreading in the Little-Hopfield neural networks, both for fully connected and strongly di- 



luted systems, has been studied in [41 . Here we generalize this study to the case of diluted 
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networks with nonmonotonic neurons. Let us consider two replicas of the same system hav- 
ing initial t — configurations with the same activity Qo and overlap mo but microscopically 
different for a small number of neurons. Subsequently the two replicas evolve, subject to 
the same dynamics since their synaptic connections are identical. The two replicas will have 
the same macroscopic parameters m(t) and Q(t) at every later time t, since the trajectories 
m(t) and Q(t) are obtained by mo and Qo iterating equations (3-4). At microscopic level 
the situation may be different and we therefore study a suitably defined distance between 
the two replicas. Let us call h l (t) and h 2 (t) the local fields acting on s 1 and s 2 , two corre- 
sponding neurons of the replicas located on the same lattice site. The distance between the 
local fields is defined by: 

d(t) = ((h\t)-h 2 (t)) 2 ) = 2(a(t)-A(t)) , (7) 

where 

A(t) = (h\t)h 2 (t))-(h\t))(h 2 (t)) (8) 

is the linear correlation between local fields at time t. In the limit N — > oo with K large 
and finite, h 1 and h 2 can be treated as gaussian variables with probability density: 



P t (h\h 2 ) = -exp 



^ ((h 1 ~ + (h 2 - tf) - " »){h 2 - „)] } , 

(9) 

where C is a normalization factor and a, fi, A are implicitly dependent on the time t. The 
time evolution law for A(t) is given by: 
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A(t + 1) = K ((s 1 (t + l)s 2 (t + 1)) - J 2 m 2 (t + 1)) . (10) 



The average of the product of corresponding neurons in the two replicas is evaluated as 
follows: 

(s\t + l)s 2 (t + 1)) = I dh 1 J dh 2 P t {h\h 2 )F 6 (h l )F e (h 2 )- (11) 

the evaluation of the integral on the r.h.s. of (|ll|) is straightforward and leads to the time 
evolution law for A(£), which can be written as follows: 

A(t + 1) = K ( jPf Dzl(z) - Dzl(z) - J 2 m 2 (t + 1)) , (12) 

1 2 A 

where Dz = e~% z —4= is the gaussian measure and 

y 2ty 



I{z) = erf (A) + X - [erf (B) - erf(C)] , (13) 

with 



A= J^L + , AZ , (14) 
Va 2 - A 2 Vv 2 - A 2 ' V ; 



B=Q-^- , AZ , (15) 
Va 2 - A 2 V^ 2 - A 2 V ; 



C=^ + ^+ , Az . (16) 
Vct 2 - A 2 y/a 2 - A 2 v ; 
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Equation flTjp , together with (3-4), solves the time evolution of A(t). We remark that 
A(t) = a(t) (i.e. d(t) = 0) is a fixed point for eq.(p^). The possible occurrence of damage 
spreading can be now seen to be equivalent to the instability of the fixed point A = a. 
We have studied this problem numerically. We find that damage spreading occurs for any 
choice of the parameters Jo, 0, K. It follows that, from a microscopic point of view, the 
motion of the system is always to be considered chaotic even though at the macroscopic level 
it can exhibit different behaviours (fixed point, periodicity, chaos). In fig. 7 we depict the 
stationary regime of d(t) in the case of periodic macroscopic dynamics and chaotic dynamics; 
the initial distance was d(0) = 10~ 5 . The macroscopic behaviour can be seen in the lower 
part of the figures (the overlap trajectory m(t)); it is a cycle with period 4 in case (a) and 
it is chaotic in case (b). Correspondingly the distance d(t) is always greater than zero (i.e. 
damage spreading occurs) and has period 4 in case (a) whereas it shows chaotic behaviour 
in case (b). 

We remark that in Ref. |L8| it has been shown that the presence of adapting synapses 
in these networks leads to reduction of macroscopic dynamics. The adapting system self- 
regulates its synaptic configuration, by its own dynamics, so as to escape from chaotic regions: 
in the stationary regime, the mean of synapses J(t) remains practically constant (equal to the 
stationary value J s tat) and the system settles in periodic macroscopic orbits. Since we found 
damage spreading for all fixed values of Jo, it follows that the adapting system also displays 
damage spreading in the stationary regime. In other words, the adaptiveness of synapses 
should not remove damage spreading although it reduces the macroscopic dynamics. However 
damage spreading may be suppressed if the neuron updating rule becomes stochastic by a 
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proper amount of noise (the two replicas being subject to the same noise, see [[?], (4lH). 

4 Conclusions. 

In this paper we have studied a diluted neural network with nonmonotonic activation function 
whose macroscopic dynamics is given by a two-dimensional map. Some properties of this non- 
linear map have been studied: the structure and non-hyperbolicity of the strange attractor; 
in particular we have analyzed the fragility of the chaos and we have shown the validity 
of a recently discussed conjecture, i.e. periodicity windows are constructed around spine 
loci. Finally we have studied the time evolution of the distance between two replicas of the 
model which evolve subject to the same synaptic configuration. We have found that the two 
replicas never become identical, and the system exhibits damage spreading for any choice 
of the parameters. In the stationary regime the distance between the two replicas does not 
vanish and the trajectory d(t) behaves in agreement with the macroscopic dynamics: it is 
periodic (chaotic) if m(t) is periodic (chaotic). 
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Figure Captions 



Figure 1: Bifurcation map of m versus J in the case K — 10 and 9 = 5. 

Figure 2: The strange attractor of map (3-4), corresponding to K = 10, 9 = 5 and J = 0.9 
(a), 0.95 (b), 0.99 (c). The star represents the fixed point F. 

Figure 3: The stable and unstable manifolds of the fixed point F (represented by the star), 
for J = 0.99, K = 10,9 = 5. 

Figure 4: First (a) and second (b) Lyapunov exponents versus 9, corresponding to K = 10 
and J = 0.9. 

Figure 5: A portion of the parameter space: (9, Jo) G [5,5.12] x [0.88,0.9]. Black pixels 
correspond to chaotic bahaviour whereas white pixels correspond to periodicity. 

Figure 6: A portion of parameter space: (9,J ) G [5,5.015] x [0.88,0.8825]. White areas 
correspond to periodic behaviour. The solid line represents the spine locus with p = 24, 
the dashed line is the spine locus with p = 64, the dotted line is the spine with 
p = 32. These curves are obtained numerically by interpolation of a finite set of points 
characterized by the condition trM = . Grey areas correspond to chaotic behaviour; 
they contain infinite periodicity windows not displayed here. 

Figure 7: The stationary regime of the distance between two configurations having initial 
distance d(0) = 10~ 5 . Squares correspond to the distance: y = d(t), while triangles 
represent the overlap: y = m(t). The parameter values are K = 10, 9 = 5, J = 0.85 
(a) and K = 10, 9 = 5, J = 0.95 (b). 
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Figure 2a 
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